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ABSTRACT 

This paper describes incentives established to confront 
longstanding differences in test performance by race and ethnicity and to set 
student performance goals. The federal No Child Left Behind Act of 2001 
aspires to set goals for subgroups defined by race/ethnicity, economic 
disadvantage, disability, and English language learner status. A growing 
number of states are setting performance targets not only for schools overall 
but for subgroups of students within the schools as well. Section 1 introduces 
the issue. Section 2 describes subgroup rules. Section 3 discusses holding all 
subgroups to the same absolute standard, noting the anticipation of school 
failure rates, use of minimum proficiency rates in Texas, and importance of 
defining subgroup status. Section 4 discusses requiring improvements for all 
groups, highlighting California. Section 5 notes the impact of subgroup rules 
on minority achievement. Section 6 concludes that despite some closing of 
racial achievement gaps, such gaps remain large. The analysis suggests that 
using subgroup targets in school accountability programs is not the answer. 
This tends to cause schools to fail, arbitrarily singling out schools with 
large minority subgroups for sanctions and excluding them from awards or 
statistically disadvantaging diverse schools that are more likely to be 
attended by minority students. The evidence indicates that the use of subgroup 
targets is counterproductive in test-based accountability systems. (Contains 
13 figures, 2 tables, and 8 references.) (SM) 
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I. 



Introduction 



While designing accountability systems for schools, state policymakers have been forced 
to confront large and longstanding differences in test performance by race and ethnicity. Some 
states have wielded test-based accountability as a tool with which to try to close the gaps in 
performance— setting performance goals not only for students overall, but for subgroups of 
students defined by race and ethnicity as well. As reflected in the legislation’s title, the federal 
No Child Left Behind Act of 2001 (NLCBA) aspires to leave no group behind, setting goals for 
subgroups defined by race/ethnicity, economic disadvantage, disability and English Language 
Learner status. However, as in many other areas of policy design, that which seems reasonable at 
first glance often has unintended consequences. 

In this paper we have four goals: to describe the types of incentives that have been 
established, to analyze some of the perverse effects these subgroup rules have on schools, to 
provide preliminary evidence on the impact of such rules on student performance, and to make 
some suggestions regarding how such rules could be re-designed. Our bottom line is that 
subgroup rules are counter-productive in test-based accountability systems. Although well 
intentioned, subgroup rules result in fewer resources and more sanctions targeted on diverse 
schools simply because of their diversity, and do not appear to have any impact on the test score 
performance of students from minority groups. 

II. Overview of Subgroup Rules 

In order to encourage schools to raise the performance of all youth, seventeen states 
report performance separately for certain subgroups of students, including minority, low-income. 



and limited-English-proficient students. In many of these states, schools are held accountable 
only for their performance overall and do not face separate expectations for each of their 
subgroups. However, a growing number of states are setting performance targets not only for 
the school overall, but for subgroups of students in the school as well. 

States have used two basic strategies for incorporating racial subgroups into a school 
accountability system. First, some states, including Texas, have set a single performance 
expectation for the absolute level of performance, that applies to schools overall and to 
subgroups of students within schools. For example, in order to reach an "exemplary" rating, 
schools in Texas are expected to achieve a 90 percent proficiency rate for their school overall as 
well as for all subgroups, including white non-Hispanic youth, Hispanic students, African 
American students and economically disadvantaged students. In order to reach an "academically 
acceptable" rating, schools must achieve at least 55 percent proficiency rates for all subgroups of 
students (raised from 50 percent in 2001). Like the Texas plan, the No Child Left Behind Act of 
2001 would require all states to establish a single minimum proficiency rate which would apply 
to all schools as well as to all subgroups of students within schools. 

However, given large differences in test performance by race, states using such systems 
face a trade-off between setting a low standard for proficiency and accepting high failure rates 
for schools containing students from disadvantaged subgroups. This trade-off is more stark in 
more integrated states, where a large proportion of schools enroll significant numbers of minority 
youth. An alternative approach, adopted in California, is to set a uniform standard for the growth 
in performance and apply the standard to the school overall as well as to all subgroups in the 
school. One advantage of the latter approach is that it avoids the problem of large differences in 



baseline performance by race by focusing on changes in performance. However, focusing on 
annual changes in performance exacerbates other problems- such as those created by the 
imprecision of test score measures, since a large portion of the change in test scores from one 
year to the next could be expected to be due to sampling variation and other non-persistent 
causes. We discuss both approaches in more detail below. 

III. Holding All Subgroups to the Same Absolute Standard 

The No Child Left Behind Act of 2001 (NCLBA) requires schools to achieve a minimum 
level of proficiency for its students overall, as well as for each subgroup in a school defined by 
race/ethnicity, socioeconomic disadvantage, disability status and English language learner status. 
The legislation allows states to create their own definition of "proficiency", based upon their own 
curriculum standards. However, the legislation circumscribes states’ flexibility by specifying the 
manner in which the minimum proficiency rate for schools is to be determined. 1 Once a state 
defines proficiency, the minimum proficiency rate for each school and subgroup is set at the 
maximum of the proficiency rate of the twentieth percentile school or the proficiency rate of the 
lowest scoring subgroup. In states with more lenient definitions of proficiency, the minimum 



'There are at least two reasons why states will still have an incentive to define proficiency 
at a low level: First, the minimum proficiency rate must be raised from its baseline level to 100 
percent within 12 years. Although a lenient definition of proficiency does not guarantee high 
passage rates in the first year, the rate of required increase in subsequent years is slower in states 
with lenient definitions. Second, subgroups that close 10 percent of the gap between their 
proficiency rate last year and 100 percent in a single year are counted as having achieved 
"adequate yearly progress" even if their proficiency rate falls below the expected level. It would 
be easier for schools to benefit from this "safe harbor" provision if their proficiency rate starts out 
at 80 percent than if their proficiency rate starts at 20 percent. 
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